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ABSTRACT 

A  general  survey  is  undertaken  of  the  techniques  used 
in  determining  loss  functions  to  be  minimized  for  the  purpose 
of  finding  optimal  (s,S)  values  in  the  Arrow,  Harris,  and 
Marschak  dynamic  inventory  modelo  A  brief  discussion  of  the 
cost  functions  and  the  aspects  of  demand,  backlogs-ing,  lag 
time,  and  discount  rate  are  presented  in  the  interest  of 
better  understanding;  of  their  use  in  the  real  world0  Analytic 
solutions  to  the  model  have  been  derived  by  two  different, 
but  related,  methods  involving  stationary  costs0  The  first 
method  involves  direct  use  of  the  cost  functions  in  a 
Markov  process  to  arrive  at  an  integral  equation  of  renewal 
which  is  developed  into  a  stationary  loss  function  by  an 
Abelian  limit  theorem*  The  second  method  involves  the 
determination  of  the  stationary  distribution  of  stock  level 
through  renewal  theory  ;  the  loss  function  for  a  represent- 
ative period  is  brought  into  the  computations  independently 
in  determining  the  expected  loss  with  respect  to  the 
stationary  distribution  of  stock  level.  The  two  methods 
produce  the  same  resulto 

A  digital  computer  simulation  of  the  Arrow,  Harris, 
and  Marschak  dynamic  model  has  been  outlined  by  M0  Geisler 
[2L  Some  highlights  of  Geisler's  work  have  been  reviewed 
here0 
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PREFACE 

Inventory  control  organizations  of  the  Navy  have  con- 
tracted for  numerous  studies  into  the  decision  problems 
involved  in  dynamic  inventory  for  the  multi-echelon  systems 
as  found  in  the  Navy.  Also,  a  contract  for  the  construction 
of  a  computerized  dynamic  model  was  first  let  in  early  1955 
to  the  Stanford  Research  Institute.  This  work  continues 
today  with  improvements  being  added  as  break-throughs  develop 
in  the  study  of  the  nature  of  complex  Navy  inventory  opera- 
tions. Industry  has  no  parallel  in  complexity  and  magnitude© 
Models  in  use  prior  to  the  early  part  of  1955  were  more 
applicable  to  reasonable-size  firms.  Consequently,  the 
boundaries  of  development  of  inventory  theory  are  now  being 
pushed  by  the  military  organization  in  keeping  with  the 
need  for  greater  efficiency  and  economy.  The  magnitude  of 
the  difficulty  in  finding  models  that  closely  approximate 
the  military  inventory  management  problem  are  appreciated 
by  relatively  few.  The  optimization  of  buying,  allocating, 
and  redistributing  based  on  complex  statistical  fluctuations 
in  demand,  order  -  arrival,  and  military  loss  due  to  shortage 

in  a  multi-echelon  structure  of  centers  and  depots  is  an 
almost  insurmountable  obstacle  to  solution  for  a  large 
part  of  the  total  carried  inventory. 

The / exposition  presented  in  this  paper  has  been  kept 

h  7 

relatively,  simple .  Its  purpose  is  to  illuminate  the  basic 


concepts  of  the  moat  simple  dynamic  inventory  problem  as 
first  presented  by  Arrow,  Harris,  and  Marschak  and,  thereby, 
gain  sufficient  insight  for  proceeding  into  more  complex 
dynamic  models0 

Source  material  for  this  paper  has  consisted  primarily 
of  references  |l]#[2L|f?L  and  notes  taken  during  a  courst 
of  instruction  in   logistics  given  by  Professor  Thomas  E» 
Oberbeck  at  the  United  States  Naval  Postgraduate  School. 
I  wish  to  express  my  gratitude  to  Professor  Oberbeck  for 
hi*  support  and  encouragement  and  to  my  wife,  Helen,  for 
her  loyal  devotion  to  the  typing  and  clerical  taskso 
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TABLE  OF  SYMBOLS 
(Listed  in  the  order  of  their  use  in  the  text) 

s  reorder  point  of  the  stock  level 

S  upper  limit  of  the  stock  level 

yt  stock  level  at  the  beginning  of  period  t 

c  ordering  cost  per  unit  of  item  ordered 

z  reorder  quantity  in  general 


loss  or  cost  function  for  the  n   period 


i(yn) 

jlco  stationary  or  equilibrium  cost  function 

J/(y)  same  as  jL(y    )  without  regard  to  time 

g(y)  stationary  density  function  of  stock  level 

f(r  )  density  function  of  demand 

xt  stock  level  at  beginning  of  period  t  after  reording 

z^  reorder  quantity  at  beginning  of  period  t 

p  penalty  cost  per  unit  of  item  not  in  stock 

h  holding  cost  per  unit  of  item  in  storage 

F(£)  cumulative  distribution  function  of  demand 

L(yg)   minimum  discounted  expected  loss  over  an  infinite 
time  period  with  initial  stock  level,  y  <j 

(X  discount  rate  which  discounts  future  losses  to 

present  value 

F  ( £  )   n-f old  convolution  for  distribution  of  demand 

v(y)     a  random  variable  having  non-negative  integer 

values  which  specify  the  number  of  periods  less 
one  in  a  reorder  cycle, 

9  S-s   random  variable  of  the  excess  distribution  or 
the  amount  by  which  stock  level  goes  below 
reorder  point  s  prior  to  reordering 
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d)v(v)      a  ran^om  variable  representing  the  sums  of 
demand  just  prior  to  (/)  ,  ,  .   which  causea 
a  reorder.  Vv(y)+1 

Prl  /g_s>uj  probability  that  excess  of  quantity  of  stock 
below  the  reorder  point  s  is  greater  than 
some  value   u» 
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1.   Introduction 

The  history  and  general  characteristics  of  the  inven- 
tory problem  under  various  operating  conditions  have  been 
adequately  discussed  in  [l]«   T^e  (s,S)  policy   is  widely 
used  in  practice  and  has  been  subject  to  extensive  analyti- 
cal study.   This  ordering  rule  is  simple  and  has  the  follow- 
ing advantages:  (i)  considerable  intuitive  appeal,  (ii)  large 
amounts  of  data  available,   (iii)  a  certain  ease  of  proba- 
bilistic computation  and  analysis  and  (iv)  existence  of 
analytic  proofs  as  to  its  optimality  under  a  wide  range  of 
conditions.   Note  that  there  are  two  approaches  to  the  inven- 
tory problem.   One  is  to  choose  a  simple  policy  (e.g.  (s,S) 
type)  and  proceed  with  the  analysis  of  specific  (s,S)  policies, 
and  the  other  approach  is  solve  the  decision  problem  through 
determination  of  the  characteristic  of  the  optimal  ordering 
policy  which,  minimizes  or  maximizes  an  appropriate  objective 
function.   Finding  the  characteristic  of  the  optimal  policy  is 
very  difficult.   Thus  the  usual  approach  is  to  choose  the 
practical  and  sound  (s,S)  policy  and  then  proceed  to  find 
within  this  policy  class  a  specific  policy  which  minimizes 
the  expected  long  run  costs  (i.e.,  specific  values  of  s  andS) . 
Then  the  study  of  the  inventory  model  becomes  a  study  of  the 
associated  stochastic  process  which  is  generally  a  Markov 
process  where  the  states  of  the  system  (current  stock  level) 
depend  on  the  past  only  through  the  present. 

Often  called  the  two-bin  policy, 
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The  Arrow,  Karris,  and  Marshak  dynamic  inventory  model 
(hereafter  called  the  AHM  Model)  is  the  generic  name  often 
piven  in  the  literature  to  identify  the  (s,S)  policy  model 
where  ordering  takes  place  at  the  beginning  of  the  period 
when  the  stock  level  is  less  than  the  level  s  (i.e.  y^.<s) 
and  demand  is  identically  and  independently  distributed  in 
each  time  period.   There  may  or  nay  not  be  a  specified 
delivery  lag.   In  this  thesis,  deliveries  will  be  assumed 
to  arrive  inmediately  after  ceinc?  ordered.   It  is  assumed 
that  the  reader  is  familiar  with  the  AHM  dynamic  model  of 
reference  |5>|.   Some  simple  restrictions  on  the  cost  func- 
tions (having  to  do  with  the  convexity  of  the  expected  values 
of  the  cost  functions)  according  to  Scarf  I  10   are  the  only 
restrictions  required  in  order  that  the  optimal  policy  for 
the  AHM  dynamic  model  be  of  the  (s,S)  type.   Thus  over  a 
wide  rangfc  of  conditions  (including  any  demand  distribution 
functions),   there  can  be  confidence  in  using  (s,S)  policies. 
Sections  2  and  3  are  devoted  to  a  resume  of  the  cost  functions 
and  other  input  factors  in  order  to  develop  a  better  under- 
standing of  their  meaning  in  analysis  and  their  relationship 
to  the  real  world.  (  X 


2.   Cost  Functions. 

The  inventory  problem  has  three  cost  functions  which 
can  have  four  forns  (linear,  convex,  concave,  or  mixed), 

a.  Ordering  Cost. 

Suppose  z  represents  the  amount  of  stock  to  be 
ordered  and  c  tne  cost  per  unit  ordered.   A  linear 
ordering  cost  is  directly  proportional  to  the  amount 
ordered,  i.e.  c«z.   The  case  where  c(z)  is  concave 
is  a  common  situation  in  buying  since  this  means     , 
that  each  additional  item  costs  less.   A  special  case 
of  concavity  exists  when  c(z)  is  composed  of  c»z+K 
where  K  is  the  administrative  costs  of  processing  an 
order.   The  convex  case  is  unlikely  to  occur  since 
it  means  that  each  additional  item  costs  more.   The 
mixed  case  where  pieces  are  -^ade  up  of  linear  and 

concave  portions  is  practical. 

i 

b.  Storage  Cost. 

Usually  storage  costs  are  proportional  to  the 
si,ze  of  stock  on  hand,  but  the  cost  may  increase  more 
rapidly  if  tne  storehouse  capacity  is  exceeded  and 
additional  space  must  be  rented.   Storage  costs  may 
include  such  things  as  stock  maintenance,  storage 
rental,  stock  obsolescence  or  spoilage,  stock  repair,  etc, 

c.  Penalty  Cost, 

These  .costs  arise  when  demand  exceeds  supply 


as  opposed  to  storage  costs  which  arise  due  to 
supply  exceeding  demand.   The  forn  of  the  penalty 
cost  function  varies  widely  since  so  many  conditions 
exist.   The  simplest  is  the  linear  case.   A  realistic 
case  for  industry  is  the  convex  function  since  a 
small  shortage  has  small  consequences  but  a  large 
shortage  produces  increasingly  greater  difficulties 
for  the  customers.   In  scne  military  applications 
certain  ite-ns  directly  affect  the  mission  and  a  short- 
age  of  these  items  will  cause  failure  of  the  mission; 
consequently  the  shortage  function  could  be  considered 
a  positive  constant  when  a  shortage  develops  and  zero 
otherwise.   In  reality,  the  military  supply  items  vary 
in  importance  and  end-use.   This  is  why  a  military 
supply  system  is  hardput  to  define  the  military  essen- 
tiality of  all  items.   So  far,  the  military  essential- 
ity designation  has  been  applied  to  the  allowance  lists 
of  designated  submarines;  however  there  is  a  move  afoot 
to  expand  this  program  to  include  all  naval  vessels. 
The  obvious  difficulty  in  this  project  lies  in  review- 
ing and  updating  the  allowance  item  essentiality 
designation. 
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3.  Other  Factors*  \ 

Inventories  are  held  for  the  ultimate  purpose  of 
satisfying  demand,  and  money  laid  out  for  orders  and  items 
of  inventory  will  not  be  returned  for  awhile.  The  alterna- 
tive to  having  money  tied  up  in  inventory  is  to  have  it 
invested  in  securities,  bonds,  or  similar  instruments0 
Long-term  government  bonds  are  a  good  standard  for 
comparison  since  they  are  both  secure  and  yield  a  reason- 
able return  of  i\.%.    Lag  time  is  the  time  between  ordering 
and  receiving,  and  it  directly  affects  the  amount  of  stock 
to  be  carried.  Backlogering  is  the  procedure  whereby  demands 
in  excess  of  stock  (unfilled  orders)  are  kept  on  the  books 
until  they  can  be  satisfied  thereby  giving  meaning  to 
negative  inventory  values* 
a*  Discount  Rate0 

A  return  of  $1.0[{.  at  the  end  of  a  year  is  equiv- 
alent to  $1.00  invested  today  in  inventory.  The  discount 
rate  is  QC~  l/l.Olj.  which  is  an  equivalent  way  of  consider- 
ing the  comparative  return.  Thus  a  $1.00  return  in  a  year 
is  equivalent  to  (X  dollars  invested  in  inventory  today* 
Considering  that  the  $1.00  return  on  investment  is  re- 
invested each  year  or  remains  invested  at  \\.%t    then  OC9 
(X    ,  (X  "#   •'•*,•<  represents  the  discount  rate  for 
$lo00  after  one  year,  two  years,  three  years,  etCo 
(ioe.  OC*  is  the  present  value  of    $1.00  which  has 
been  tied-up  in  inventory  during  the  n   period). 


For  all  practical  purposes  CX=  1  when  the  time  horizon 
is  short. 

b •   Demand  » 

Demand  is  usually  assumed  to  be  independent 
of  the  decision  makers  control;  however,  this  is  not 
always  the  case  in  industry  (e.g.  demand  is  directly 
related  to  advertising) 0  In  military  inventory  it  seems 
safe  to  assume  that  demand  is  independent  of  the  decision 
maker.  Demand  may  be  regarded  as  deterministic  in  future 
time  periods.  However,  it  is  more  realistic  to  regard 
demand  as  probabilistic.  Although  the  demand  probability 
distribution  may  be  known  to  change  such  as  in  seasonal 
fluctuations  or  long-term  trends,  the  state  of  methodology 
in  stochastic  processes  for  inventory  control  requires 
the  assumption  that  demand  is  identically  distributed 
in  the  time  periods.  Eecause  of  this  restriction,  the 
deterministic  case  is  sometimes  a  better  approximation 
for  demand  when  it  is  rapidly  changing  over  time  (i.e.  the 
deterministic  case  fixes  demand  in  the  various  time 
periods  according  to  some  previous  knowledge  of  its 
behavior) » 

Another  way  of  looking  at  the  aforementioned 
probabilistic  case  is  to  allow  the  size  of  each  demand 
to  be  a  random  variable^  Consequently,  this  is  a  con- 
tinuous time  stochastic  process  which  is  more  appropriate 
when  orders  can  be  placed  at  any  moment  of  time0  For 
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application  of  this  concept,  the  assumption  is  made  that 
demands  are  independent  and  identically  distributed  random 
variables. 

When  nothing  is  known  of  demand  one  may  apply 
decision-making  under  uncertainty  as  developed  by  Wald 
[3]  which  involves  both  estimation  and  decision-making 
as  successive  observations  of  demand  are  taken,  a  com- 
plicated sequential  decision  problem.   Y.  Fukuda  provides 
a  qualitative  approach  to  this  solution  [4]« 
Co   Lag  Time. 

There  are  three  cases  of  lag  time  to  consider. 
In  this  thesis  the  time  between  order  and  delivery  is 
assumed  to  be  zero  in  order  not  to  over-complicate  the 

computational  techniques  to  be  displayed;  however  the 

« 

extension  of  this  model  to  the  case  of  fixed  lag  time 
between  order  and  delivery  is  presented  by  Karlin  and 
Scarf  [l]  and  has  the  same  characteristics  as  the  dynamic 
inventory  model  with  no  lag  time  when  both  models  assume 
backlogging  (see  subsection  3d).  The  case  where  lag  time 
is  a  random  variable  has  been  treated  by  Scarf  fl]  (see 
chapter  16). 

It  should  be  noted  that  when  demand  is  deter- 
ministic, the  consideration  of  fixed  lag  time  is  in- 
consequential  since  we  could  order  sufficiently  in 
advance  to  cover  the  known  demands.  In  all  cases  the 


lag  time  directly  affects  the  amount  of  stock  held 
(i.e.  an  increase  in  inventory  to  protect  against  short- 
ages until  deliveries  arrive).  There  is  onepractical 
consideration  in  the  dynamic  model  where  lag  time  is 
a  random  variable  for  which  no  solution  has  been  found 
through  the  dynamic  programming  formulation  at  the 
present  time  and  that  is  the  condition  where  orders 
arrive  out  of  sequence*  This  is  referred  to  as  cross 
over.  Remember  that  order  quantity  is  a  random  variable. 
do   Backlogging*o 

When  demand  for  an  item  exceeds  supply,  then 
the  policymaker  may  do  one  of  several  things:  (i)  make 
a  premium  order  thereby  taking  a  penalty  in  the  amount 
of  the  premium  costs,  (ii)  do  nothing  and  allow  the 
customer  to  go  elsewhere  for  satisfaction  thereby  taking 
a  penalty  in  customer  goodwill,  (iii)  backlog  the  order 
awaiting  arrival  of  orders  to  satisfy  the  unfilled  demand 
thereby  taking  a  penalty  that  may  relate  to  both  customer 
goodwill  and/or  increased  ordering  costs.  In  this  case 
a  negative  inventory  becomes  meaningfulo 


1;0  Methods  of  Solution  Available. 

At  this  juncture  there  exists  a  stochastic  process 
based  on  the  (s,S)  type  policy  which  may  now  be  treated 
in  one  of  two  ways<> 

a.   First  Way© 

The  first  way  consists  of  viewing  the  transient 
behavior  of  the  stochastic  process  through  n-periods 
or  an  infinite  number  of  periods.  This  essentially  is  the 
original  approach  used  by  Arrow,  Harris,  and  Marschak 
|5>],  [9]  in  setting  up  the  loss  function  for  a  general 
period  t,  then  summing  the  expected  losses  over  a  given 
time  horizon  with  respect  to  the  random  variable  of 
stock  levelo  The  distribution  of  stock  level  is  deduced 
through  a  functional  relation  with  the  random  variable 
of  demand.  This  method  will  be  outlined  in  section  5  where 
it  will  be  pushed  to  an  approximate  solution  through  use 
of  an  integral  equation  of  renewal  theory  [l  L  [5 Jo 

b«  Second  Way* 

The  second  method  of  treatment  deals  with  the 
stationary  phenomena  of  the  process,,  If  yn  represents 
the  stock  level  at  time  n,  then  subject  to  mild  stabil- 
ity  requirements  it  can  be  shown  jll(refer  to   pages 
23U-237  and  pages  292-297)  that   y   possesses  the  so- 
called  ergodic  property  (i.e.  the  distribution  function 

for  y   converges  to  a  limiting  distribution  function) 
n 

when  the  optimal  policy  is  of  the  (s,S)  type0  Thus  the 
limiting  or  stationary  distribution  is  a  function  of 
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the  policy  and  the  demand  distribution,  and  it  is  in- 
dependent of  the  initial  stock  level.  The  beauty  of  this 
method  is  that  the  cost  functions  have  not  entered  into 
the  problem  up  to  this  point.  Using  the  loss  function 
representation  for  a  general  period  n,  denoted  X(y„)# 
and  dropping  the  dependence  on  n,  the  expected  value 
of  £(y)  with  respect  to  the  stationary  density  yields 
the  equilibrium  average  loss,  denoted  as  follows: 


CO 


./* 


y)  g(y)  dy 


where  g(y)  denotes  the  stationary  distribution  for  the 
stock  level» 

The  stationary  distributions  discussed  in  subsection 
2b  can  be  found  through  the  application  of  renewal  theory 
I  l](refer  tp,  chapter  15>)  or  through  the  application  of 
differential  equations  f  1  ]( refer  to.,  chapter  11;)  when 
the  demand  distribution  function  is  a  member  of  the 
Gamma  family  of  distributions© 


/ 


i 
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5p    Original  Method  of  Solution. 

It  is  proposed  that  the  original  Arrow,  Harris, 
and  Marschak  dynamic  model  be  solved  for  the  optimal 
value?  of  (s,S)  where  the  demand  density  function  is 
specified  as  f(£)  = £~^  .  The  detailed  computations 
are  straightforward  and  can  be  found  in  Appendix  I.  The 
rule  of  action  for  time  period   t   with  y.  as  the  stock 
level,  x^  as  the  stock  level  including  replenishment, 
and  t.    as  the  demand  are  represented  both  analytically 
and  graphically  as  follows: 

If  y.>B,    then  zt=0  (and  x tayt) 
If  y.^.s,  then   z  =S-yt  (and  x.=S) 


time 


Steck  Level! as  a  function  of  Time 
(Figure  1 


Let  c(°),  p(*),  and  h(°)  pe  the  ordering,  penalty,  and 

t 
holding  cost  functions  respectively.  This  model  has  cost 
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functions  defined  as  follows: 

c(0  =  K 

p(»)  =  P 
h(»)  =  hxyt 

Under  an  (s,S)  policy  with  the  initial  stock  position, 
y  ,  specified,  there  is  a  Markov  process  on  the  sequence 
of  values  for  the  stock  level.  The  loss,  x(y. ),  in  any 
peried  (t,  t+1)  depends  on  the  stock  level,  y  ,  at  the 
beginning  of  the  period,  the  cost  functions,  and  the 
demand  distribution  function,  F(£): 

(5a)       Z<rt)=ihX7t  +  Pr[l"P<yti]        ^    S<Tt"S 

'    h*S  ♦  p  T  l-F(S)j     for     yt-a 

An  important  feature  of  the  function  JCijf.) ,  which  will 
be  used  later  in  finding  the  optimal  (s,S)  values,  is 
that  the  function  involves   s  and  S   as  parameters  ani 
is  constant  with  respect  to   y.  ^s;  thus  X,{0)    -  X(S)  =*  K© 
Consider   L(y  )  as  the  minimum  discounted  expected  loss 
which  will  be  incurred  during  an  infinite  time  period  if 
y   is  the  initial  stock  level  and  an  optimal  ordering  rule 
is  used  throughout  this  infinite  time  periodo  If  an  order 
at  the  first  stage  brings  the  stock  level  up  to  afi  amount 

y   and  an  optimal  ordering  policy  is  followed  in  :the 

/ 
second  stage  onward,  then  the  expected  loss  from  the 

second  stage  onward  discounted  to  the  present  is: 
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OC  /  /   L(S-£)  dF(£)+Uo)fl-P(S) 


if  y^s 


(5.2) 


a 


L(y-£)  dF(£  )+L(0)|l-F(y)j   if  y 


>s 


Consequently,  the  minimum  expected  loss  is  achieved  by 
the  policy  that  minimizes  the  sum  of  the  expected  loss 
for  the  first  period  and  the  discounted  minimum  expected 
losses  in  the  future: 

(5o3)   L(y)«£(y)+«/   L(S-£)  dP(  £  )+<XL(0)  [l-P(S)] 

°~  if  y^i 

i$.k)      L(y)=X(y)  +  a/   L(y-£)  dF(  £  )-KXL(0)  [l-F(y)] 


if  y>s 


These  are  the  same  functional  equations  (i4-.ll)  and  (U«l  ) 
of  [5j  showing  the  recursive  properties  of  the  dynamic 
model.  The  lower  limit  of  integration  is  set  at  0-  iri 
order  to  insure  that  the  random  variable  for  demand,  §, 


'  \ 


'does  not  have  a  positive  probability  at  t  =0,  and,  there- 
by, avoid  a  discontinuity  in  the  Stieltjes  integral 
The  exposition  in  this  section  could  be  shown  for  the 


\ 


case  in  which  the  demand  distribution  is  discrete  and     \ 


all  functions  are  defined  on  integer  values;  the  integrals 
would  be  replaced  by  appropriate  summations.  « 
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It  was  noted  earlier  in  equation  (5.1)    that  £(y) 
is  independent  of  y   for   0  —  y— s0  Note  in  equation 
(5.3)  that  L(y)  is  independent  of   y   for  0^y^-so 
Putting  y=0  in  (5.3)  and  y=S  in  (5»U)>  then  subtracting 
the  latter  from  the  former  producea: 

(5.5)    L(0)  -  L(S)  =i(0)  -i(S)  =  K 

Equation  (5«U)  can  be  solved  for  the  function  L(y)  by 
•onsidering  L(0)  as  an  unknown  parameter,  then  (5.5) 
can  be  used  to  find  L(0)«  But  before  this  solving  takes 
place,  (5«U)  is  changed  into  the  usual  form  of  the 
integral  equation  of  renewal  theory  whose  solution  is 
found  in  terms  of  L  and  )L*    It  is  this  solution  that  is 
used  to  find  L(0),  Substitutions,  change  of  variable,  and 
renewal  summation  of  convolutions  for  demand  provide  tha 
means  for  finding  a  sol&tion  [5  Jo 

The  stepa  begin  by  breaking-^up  the  integral  on  the 
right  side  of  (5.U): 

/  L(y-£)  dF(f  )=/    L(y-f  )  dP(f  )♦/    L(y-£)dF(£ 

-y-a 


=  /    L(y-£)dF(£)+L(0)  /    dF(£ 

Jq  Jj-* 


In  the  last  term  L(0)  =  L(y-s).   Substitute  this 


Ik 


into  {S»h)»    then  in  the  next  step  substitute  7|  =  y-s   and 
L(y)  =  L(7}+s)  =A(7])i 

C5.I+)1   L(y)=/(y)+a/   L(y-£)dF(£)+(XL(0)/    dF(£)+Oa(0)[  i-F(y )] 

J0  Jy-a 

A(7|)=i(^^)+a/   A(7]-£)dF(^)  +  aL(0)/p(y)-P(^)  +  [l-F(y)]> 
AC7[)*i(7J+s )■!■«/  A(7?-^)dF(f)+aL(0)[l-F(7])]   fer  7]>0 

^0 


This  is  the  integral  equation  of  renewal  theory.  The  n-fold 

convolution  of  the  distribution  of  demand  is  F  (£)  which 

n  o 

is  used  in  the  solution  of  (5»U)  as  follows: 

00  . 


(5.6)     h   <f)  -£  anv£) 


n=l 
where  the  convolutions  are  defined  as  follows 


Fx(f )  =  P(£) 

Pn(^  =/   Fn_l(£.u)dF(u) 

Jo 


for  n=2,  3, 


•  •  • 


The  solution  to  (5«U)  in  terms  of  L  and  J^  is  shown  on 
page  33  of  [5]  t 
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/S-s 
i(s-£)dHa(£) 


(5.8)   L(o)  = 


(l-00[l*Ha(S-s)] 

As  pointed-out  on  page  3h   of  j5|>  the  determination  of  the 
optimal  policy  which  minimizes  L(0)  is  tantamount  to  find- 
ing the  optimal  policy  that  minimizes  L(jq)    provided  that 
the  optimal  value  of   s   is  greater  than  zero0  The  finding 
of  the  optimal  (s,S)  policy  required  that  the  system  of 

equations  ~-L(0)  =  0  and  ^-r-L(O)  =  0  be  solved  in  terms 

dS  *2°^ 

of  S  and  A=  S-s.  Also  r-^LtO)   must  be  positive  for  the 

minimum  to  exist.  The  appropriate  equations  are: 

*  fS'* 

(5.9)    |^L(0)=h-pxf(S)+|    [h-pxf(S-£)]dH0((^)  =  0 

rs-9 

|^L(0)=h(S-s)-p[f(S)-F(s)]+K+/    [h-Pxf(s-f)]HCX(£)df 
It  is  assumed  that  H^lf)  =  /   h-^Ct)  dt„ 

,   .    u       Jo     u 

One  can  find  h/-y(c)  for  many  demand  density  functions 
which  have  practical  application  to  actual  demand  behav- 
ior* However,  solving  (5.9)  for  the  optimal  (s,S)  values 
may  require  numerical  methods,, 

The  other  alternative  to  this  method  is  a  simulation 
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CO 


of  (5«8)  using  predetermined  functions  of  dH/y(£)  =2_OC  F  (c)» 

For  some  guidelines  on  the  number  of  runs  necessary  for  a 

95%   confidence  level,  see  Geisler  [  2  J.  An  attempt  was  made 

to  set-up  this  simulation  on  the  CDC  I6OI4.  computer  using 

FORTRAN  machine  language;  however,  unf amiliarity  with 

FORTRAN  caused  the  effort  to  be  time  consuming  both  in 

preparation  of  the  program  and  in  debuggingo  It  is  suggested 

that  the  next  undertaking  of  this  problem  begin  very  early 

in  the  learning  phase  of  programming  and  that  another 

machine  language,  such  as  SCRAP,  be  investigated  for  better 

adaptability  of  this  problem* 

As  foretold  in  section  1  the  equation  is  now  trans- 

formed  to  a  stationary  cost*  equation  which  implies  that 

the  loss  in  period   t,  jL  ,    approaches  a  limiting  value 

Xoq   as   t->~oo  and  is  independent  of  y  ,  the  initial  stock 

level.  By  use  of  a  standard  Abelian  theorem  [  10 1  and  as 

heuristically  outlined  on  pages  37-38  of  |5L  the  right 

side  of  equation  (5.8)  may  be  multiplied  by  (l-CO#  and 

letting  OC-fr-1  as  suggested  by   Him   (l-CX)L(O)  * j^,  the 

stationary  loss  equation  is  obtained: 

S-s 


K  +  i(S)  ♦  j      £(S-£)  dH(£  ) 

X*CO    ~ 


1  +  H(S-s) 


A  solution  using  demand  density  function  f(£  )  =  6"  will 
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be  found  so  that  a  comparison  can  be  made  with  the 
solution  in  section  60  Cn  parie  39  of  5   ,    demand  den- 
sities of  the  type 


■i 


f( 


£)  =£_/  U   e     du,    k>0   and  J3>0 


(where  k  is  an  integer)  are  shown  to  give  the  following 
results : 


*w£>  = 


n     l/k  ri         n 


(X 


Zu/j  € 


1A0  . 


du 


The  gamma  type  density  function  is  chosen  since  the  product 
of  the  characteristic  function  n-times  yields  another 
gamma  density  with  parameters   nk  and  R    (the  sum  or 
addition  of   n   independent  identical  random  variables 
is  the  product  of  the  characteristic  function  n-times. )»  Here 


Fo 


$    LxJ*       are  the  k   roots  of  unity. 


r  f(M  sf    ,  the  parameters  are   k=l   and  yfi=l 


(thus  (jj     =  1).  Since  0C  =  1,  then 


£ 


H( 


£ )  =  f    e"u  (  eu)  du  =£ 
Jo 


and    thus, 


i   - 


-s 


K+hS+pf+  ih(S   -s^) 


1  4-S-s 
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As'  shown  in  Appendix  I  for  fixed  A  =  S-a,  the  minimum 
occurs  at 


S  =  JU Jtt(l+A)  +  A 

h 


s  =  £a At(l+A) 

h 

However,  it  is  useful  for  comparison  with  other  methods 
of  solution  to  find  the  optimal  value  of  A  o  Prom 
Appendix  I, 


y2K 
- 


_s    h  +V2Kh 

e '  = 


which  will  turn  cut  to  be  the  same  solution  in  section  6 
wher«in  the  stationary  distribution  for  stock  level  was 
used. 
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6,   Solution  Using  Stationary  Distributions  of  Stock  Levol0 

As  noted  in  chapter  15  of  [l],  /too  =  g™   ( 1-OC  )  L(y) 
may  be  also  determined  by  finding  the  stationary  distri- 
bution of  the  stock  level  and  afterwards  calculating  the 
costs  for  a  single  stage  problem  where  the  stock  level 
is  a  random  variable  having  the  stationary  distribution. 
The  stationary  distribution  may  be  obtained  for  a  general 
demand  density  function  f(  r  )  and  ia  composed  of  two 
sections.  For  stock  level,  y,  in  the  range  js,S|, 

CO 

(6.1)    g(y)  =  C  Y,   Pn-(S-y)      for   s^y^S 

n=l 

The  constant   C   is  determined  by  the  appropriate  boundary 

conditions  and  F   is  the  n-fold  convolution  of  the  demand 

n 

distribution  function  (cf.   equation  5«6)a  The  stationary 
density  function  for  y<s  is  a  multiple  of  the  so-called 
excess  distribution  for  the  renewal  process  of  independent 
random  variables  £.  „  Although  (6.1)  may  be  difficult  to 
find,  the  distribution  for  the  excess  variable  is  more 
readily  obtained  by  use  of  Laplace  transforms0  The 
excess  variable  can  be  characterized  as  ', 


•s 


^1^2  b  vfy)n  "     D/    ^s- 

where  v(y)  is  a  random  variable  whose  talue  may  be  an 
integer  from  the  set  (0,1,2,3,  )  satisfying  the 
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following  inequalities: 


v(y) 


o   + 


£v(t)+1 


S-s 


Letting 


^v(y)    Sl   S2 
*>(y)+l   Sl   s; 


+  £         and 
^v(y) 


^v(y)+l      » 


the  excess  variable  of  y  may  be  pictured  as  follows: 


Z 


S-s 


^ 


S-s 


</> 


(7)  >rv(y)+l 

Excess  Variable  of  S-s 
Figure  2 


The  renewal  type  equation  follows  from  this  definition  of 


pr  Ks-S>u 


■S-s 


Pr 


7    >u  dF(y)+fl-F(S-s-u)L 
rS-s-v  I  J 


A  renewal  process  is  defined  as  a  stochastic  process 
composed  of  sums  of  positive  identically  distributed  and 
independent  random  variablese  This  much  of  the  theory 
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is  presented  in  order  to  provide  some  intuitive  appealo 
Those  interested  in  the  detailed  study  of  renewal  processes 
are  referred  to  chapter  15  of  [lj» 

When  the  demand  density  functions  are  members  of  the 
gamma  family,  the  stationary  density  function  of  stock  level 
may  be  derived  alternately  through  the  use  of  differential 
equations  as  in  chapter  II4.  of  [ljo  The  stationary  distri- 
bution, g(y),  for  the  case  where  f(£)  =  C  is  taken  from  111 
and  is  found  to  be 


g(y)  =< 


1  ♦  S  -  s 


for   s<y^S 


1  ♦  S  -  s 


e"(S'y)   for  y^s 


The  stationary  loss  is  a  straight  forward  calculation 


< 

lco=  I    £(y)  g(y)  dy 


where    the   one   period    loss    in   our   case    is    set-down   in    (5*1)    as 

hy   +   p[l-F(y)J  for    s<y^S 


i(y)    -< 

uhS  +  p[l-P(S)J 

Since   F(£)    =   1-6,    then 

hy   ♦  P[6"y] 


for     y^s 


iw  = 


for    s<y^S 
hS   +  p[6"^      ♦  K  for     y^a 

Sind#  "our  model   allows   backlogging,    negative    stock   levels 
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may  exist,  and  then 


00   J  1+S-s  J  1+S-s 

K  ♦  hS  ♦  peS  ♦  ih(S2-s2) 
1  ♦  S  -  a 

This  is  the  same  stationary  cost  function  as  (5*10),  and 
the  solutions  are  the  same. 
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7.   The  Simulation  Problem. 

^The  great  advantage  in  the  use  of  renewal  theory  is 
that  the  cost  functions  enter  separately  into  the  solution 
and  in  addition  they  enter  into  a  simple  expected  value 
form  with  respect  to  the  stationary  density  of  stock  level. 

Thus  the  cost  functions  may  be  more  complicated  without 

I 
unduly  burdening  the  solution.   This  approach  also  provides 

i 

a  more  flexible  nethod  for  simulation  wherein  the  program 
i 

will  not  be  vtied  down  to  a  specific  set  of  cost  functions 
as  would  be  the  case  in  a  simulation  of  the  equation  for 

L(0),  pointed  qut  earlier  in  section  5>. 

*        r  i 
Geisler's  jreport  [_2J  provides  a  statistical  evaluation 

1 

of  the  sample  size  required  for  a  desired  level  of  precision 
for  estimating1  shortages  and  overages  (i.e.  stock  level 
above  7,ero)  in  the  AHM  dynamic  model  for  both  lag  and  n© 
:  lag  in  delivery  with  linear  penalty  and  holding  cost  and  or- 
'  dering  cost,  K  +  c«z.   The  precision  represents  a  way  of 
finding  sample  size  when  the  mean' number  of  shortages  or 
overages  is  within  K%   of  the  true  value  with  95$  confidence. 
Part  D  of  Geisler's  report  has  sections  III  and  IV  which 
analyze  the  e-iven  model  by  inventory  cycles  and  by  time 
periods, respectively .   The  time  period  model  is  what  has 
been  discussed  in  this  thesis.   The  inventory  cycle  is  the 
number  of  periods  between  reorder  where  the  number  of 
periods  is  a  random  variable.   The  concepts  in  renewal  theory 

2h 


arc  covered  in  chapter  15  of  [l] ,  sections  III  and  IVo 

Sections  III  and  IV  outline  the  analytic  solutions. 
Subsection  III-3»b  shows  the  specific  expected  costs  with 
respect  to  the  stationary  density  of  stock  level  when 
f(c)  =  AG  •   ^n  subsection  IV-2,  the  expected  values  of 
shortage  level,  stock  level  (overage),  and  reorder  quanti- 
ty per  period  are  given  on  pages  79,  85,  and  89  respec- 
tively.  To  fret  the  stationary  loss  (cost)  multiply, 
respectively  by  p,  h,  and  c.   To  the  reorder  cost  -L.c 
must  be  added  -  ,  — ttt  •   Consequently  Geisler's  report  has 

Ml+XA) 

provided  an  exercise  reference  in  the  study  of  renewal 

theory  and  its  utilization  in  finding  an  analytic  solution 

to  the  AKM  dynamic  model  with  less  restrictive  cost  functions. 

When  the  stationary  costs  have  been  derived,  either  directly 

or  by  use  of  numerical  methods,  a  simulation  can  be  under- 

\ 
taken  to  find  the  optimal  (s,S)  policy  which  minimizes  the 

stationary  loss  function.   Section  V  of  part  D  can  be  used 

in  the  simulation  to  determine  sample  sizes. 


i 


1 
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APPENDIX  I 

9.  Computations  for  the  Original  AHM  Solution  of  Section  So 

Starting  with  the  case  where  f  (£)=*£*£  ,    the  values 
of  (s,S)  in  functional  form  will  be  found  that  minimize 

K+hSO  pe"S  +ih(S2-s2) 

Zoo   "       "     "  " 

1+S-s 

Let   A=S-So 

^      (1+S-s) (h+hS)-  [K<»KS+p6"a0  ih(S2-s2)] 

w    ^-Xoo=" ~5 -~ — 

d5  (l*S-s)* 

^      .  (H-3-3)(.peS-hs)-rK^hS+pe*+ih(S2-s2)]  (-1) 

©    &£<~>* o " L^ 

^S  (1+S-s)2 


<D  «      h+hA+hS+hsA-K-hS-p£f8   -|Ah(.S+s)    *  0 
h+hA+^Ah(S-s)-K-pe*S   =0 
-K-p9"s+h+Ah^A2h  =   0 

©  i      -p9f-ApeS-hs-Aha^K+hS+pe"S"»^AhS-»^Ahs  *  0 

-Ape"s+h(s-s)+iAhs-iAhs+K  =  0 

-K  =  -Ape"S+hA+iAh(S-s) 

-k  «  -Ape"s+hA+^hA2 

Substituting    (f)  »    into    (J)  •    for   -K   : 

(-Ape"a^AHhA2)-pe"s+h+hA+*HA2  =  o 
-pe"s(1+A)+h(A2+2A+D  =o 
peau+A)  -fcli+A)2 
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—  e    -  i  t  A 

h 


es  = 


h(l+A) 


i*  «  J*,-  -  U  (i+A 


s*  »  &l—  -  L  d+A)  +  A 

h 


8   and  S   denote 


©ptimal  values 


These  results  agree  with  page  I4.O  of  [5J  where  A  lias  a 
fixed  value.  In  order  to  solve  explicitly  for  A,  a 
mathematical  device  must  be  used0  This  device  consists 
of  removing  the  variable   h  by  taking  the  loss  function 
with  respect  to  h  after  certain  substitutions  into  Xoo' 
Substitute  the  following  into  )Lml 


'CD 


-3 


P6     -  h(i+A*) 


,*=  SL 


h(l+A*) 

;•  =  JL      P 


h(l+A*> 


*>+A* 


K>h 


A- CO  = 


SL — - — +A*  +h(i*A*)*ihA*f2  h, 
h(i+A*)       J  L 


h(l+A*) 


A* 


n-A* 


^co~ 


K«-h |i  A*+2  A**l  +h ( 1+  A" )   $*>  — tt 


U  A* 


28 


h      ^       i+A*  i+A 

K  p 

whore  K"  = —  and  pM  «- —  •  A  check  of  the  consistency  in  the 
h  h 

units  of  the  equation  shows  that  1'  =  (one  charge-unit/period) 
*  (storage  cost/unit-period ) (no,  of  units  stored,  averaged) » 
In  the  first  term  the  order  handling  charge  is  divided 
equally  among  the  number  of  units  in  the  dynamic  range  of 
+1»  The  third  term  is  the  penalty  premium  expressed  in 
(l1  units x  1  Unit)  and  averagedo  This  analysis  of  consist- 
ency helps  verify  the  propriety  of  the  substitutions©  Now 
minimize  with  respect  to  A'  • 

d      „    -k»  ^  (i+A*)(2+A*)-(iA*g +2A*+D    i+A* 

^2"    f  (i+A*)2  *  (i+A*)2  "  (i+A*)2 

-k»+[A*+  +3  A*  +2  -iA*2-2A*-i]-i  +  A*  «  o 

-k"  ♦  k  A*2  ■  o     t 

t /  2K 

a  *  v^^  -  y — ■ 

To  set  the  (s  ,S  )  values  after  A    Is  determined,  an 
equations  for  s#  is  used: 


Pe"s  =  h(i+A"> 

h     [2\ 

=  —  (i+y— 

D    /  h 


/"2K        h+  \/2Kh 


p 

This  completes  the  analysis. 
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